CONTROL SYSTEM AND METHOD FOR CONTROLLING 
AN ACTUATED PROSTHESIS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] The present application claims the benefit of U.S. provisional patent applications No. 
60/405,281 filed August 22, 2002; No. 60/424,261 filed November 6, 2002; and No. 
60/453,556 filed March 11, 2003, all of which are hereby incorporated by reference. 

TECHNICAL FIELD 

[0002] The present invention relates to a control system and a method for controlling an 
actuated prosthesis. This invention is particularly well adapted for controlling an actuated leg 
prosthesis for above-knee amputees. 

BACKGROUND OF THE INVENTION 

[0003] As is well known to control engineers, the automation of complex mechanical systems 
is not something easy to achieve. Among such systems, conventional powered artificial limbs, 
or myoelectric prostheses, as they are more commonly referred to, are notorious for having 
control problems. These conventional prostheses are equipped with basic controllers that 
artificially mobilize the joints without any interaction from the amputee and are only capable 
of generating basic motions. Such basic controllers do not take into consideration the dynamic 
conditions of the working environment, regardless of the fact that the prosthesis is required to 
generate appropriate control within a practical application. They are generally lacking in 
predictive control strategies necessary to anticipate the artificial limb's response as well as 
lacking in adaptive regulation enabling the adjustment of the control parameters to the 
dynamics of the prosthesis. Because human limb mobility is a complex process including 
voluntary, reflex and random events at the same time, conventional myoelectric prostheses do 
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not have the capability to interact simultaneously with the human body and the external 
environment in order to have minimal appropriate functioning. 

[0004] For example, in the case of artificial leg prostheses for above-knee amputees, the 
complexity of human locomotion resulted in that the technical improvements of conventional 
leg prostheses have until now been focused on passive mechanisms. This proved to be truly 
detrimental to the integration of motorized leg prostheses onto the human body. According to 
amputees, specific conditions of use of conventional leg prostheses, such as repetitive 
movements and continuous loading, typically entail problems such as increases in metabolic 
energy expenditures, increases of socket pressure, limitations of locomotion speeds, 
discrepancies in the locomotion movements, disruptions of postural balance, disruptions of the 
pelvis-spinal column alignment, and increases in the use of postural clinical rehabilitation 
programs. 

[0005] The major problem remains that the energy used during mobility mainly stems from 
the user because conventional leg prostheses are not equipped with servomechanisms that 
enable self-propulsion. This energy compensation has considerable short and long-term 
negative effects resulting from the daily use of such prostheses. Accordingly, the dynamic 
role played by the stump during locomotion renders impossible the prolonged wearing of the 
prostheses as it may create, among other things, several skin problems such as folliculitis, 
contact dermatitis, edema, cysts, skin shearing, scarring and ulcers. Although these skin 
problems may be partially alleviated by using a silicone sheath, a complete suction socket, or 
powder, skin problems remain one of the major preoccupations today. 

[0006] As well, the passive nature of the conventional leg prostheses typically leads to 
movement instability, disrupted movement synchronism and reduced speed of locomotion. 
Recent developments in the field of energy-saving prosthetic components have partially 
contributed to improve energy transfer between the amputee and the prosthesis. Nevertheless, 
the problem of energy expenditure is still not fully resolved and remains the major concern. 
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[0007] Considering this background, it clearly appears that there was a need to develop an 
improved control system and a new method for controlling an actuated prosthesis in order to 
fulfill the needs of amputees, in particular those of above-knee amputees. 

SUMMARY OF THE INVENTION 

[0008] In accordance with one aspect of the present invention, there is provided a method for 
determining a portion of locomotion and a phase of locomotion portion in view of controlling 
an actuated prosthesis in real time, the method comprising: 

[0009] providing a plurality of main artificial proprioceptors; 

[0010] receiving a data signal from each of the main artificial proprioceptors; 

[0011] obtaining a first and a second derivative signal for each data signal; 

[0012] obtaining a third derivative signal for at least one of the data signals; 

[0013] using a set of a first state machines to select one state among a plurality of possible 
states for each main artificial proprioceptor with the corresponding data and derivative signals; 

[0014] generating the phase of locomotion portion using the states of the main artificial 
proprioceptors; and 

[0015] using a second state machine to select the portion of locomotion among a plurality of 
possible portions of locomotion using events associated to the data signals. 

[0016] In accordance with another aspect of the present invention, there is provided a method 
for controlling an actuated prosthesis in real time, the method comprising: 

[0017] providing a plurality of main artificial proprioceptors; 

[0018] receiving a data signal from each of the main artificial proprioceptors; 
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, [0019] obtaining a first and a second derivative signal for each data signal; 

[0020] obtaining a third derivative signal for at least one of the data signals; 

[0021] using a set of first state machines to select one state among a plurality of possible states 
for each main artificial proprioceptor with the corresponding data and derivative signals; 

[0022] generating the phase of locomotion portion using the states of the main artificial 
proprioceptors; 

[0023] using a second state machine to select the portion of locomotion among a plurality of 
possible portions of locomotion using events associated to the data signals; 

[0024] calculating a locomotion speed value; 

[0025] determining coefficient values from a lookup table using at least the phase of 
locomotion portion, the portion of locomotion and the locomotion speed value; 

[0026] calculating at least one dynamic parameter value of the actuated prosthesis using the 
coefficient values from the lookup table; and 

[0027] converting the dynamic parameter value into an output signal to control the actuated 
prosthesis. 

[0028] In accordance with a further aspect of the present invention, there is provided a device 
for determining a portion of locomotion and a phase of locomotion portion in view of 
controlling an actuated prosthesis in real time using a plurality of main artificial 
proprioceptors, the device comprising: 

[0029] a data signal input for each of the main artificial proprioceptors; 

[0030] means for obtaining a first and a second derivative signal for each data signal; 
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[0031] means for obtaining a third derivative signal for at least one of the data signals; 

[0032] a set of first state machines, the first state machines being used to select one state 
among a plurality of possible states for each main artificial proprioceptor with the 
corresponding data and derivative signals; 

[0033] means for generating the phase of locomotion portion using the states of the main 
artificial proprioceptors; and 

[0034] a second state machine, the second state means being used to select the portion of 
locomotion among a plurality of possible portions of locomotion using events associated to the 
data signals. 

[0035] In accordance with a further aspect of the present invention, there is provided a control 
system for controlling an actuated prosthesis in real time, the system comprising: 

[0036] a plurality of main artificial proprioceptors; 

[0037] means for obtaining a first and a second derivative signal for each data signal; 

[0038] means for obtaining a third derivative signal for at least one of the data signals; 

[0039] a set of first state machines, the first state machines being used to select one state 
among a plurality of possible states for each main artificial proprioceptor with the 
corresponding data and derivative signals; 

[0040] means for generating the phase of locomotion portion using the states of the main 
artificial proprioceptors; 

[0041] a second state machine, the second state machine being used to select the portion of 
locomotion among a plurality of possible portions of locomotion using events associated to 
data signals; 
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[0042] means for calculating a locomotion speed value; 

[0043] means for storing a lookup table comprising coefficient values with reference to at 
least phases of locomotion, portions of locomotion and locomotion speed values; 

[0044] means for determining actual coefficient values from the lookup table using at least the 
phase of locomotion portion, the portion of locomotion and the locomotion speed value; 

[0045] means for calculating at least one dynamic parameter value of the actuated prosthesis 
using the coefficient values from the lookup table; and 

[0046] means for converting the dynamic parameter value into an output signal to control the 
actuated prosthesis. 

[0047] These and other aspects of the present invention are described in or apparent from the 
following detailed description, which description is made in conjunction with the 
accompanying figures. 

BRIEF DESCRIPTION OF THE FIGURES 

[0048] FIG. 1 is a block diagram showing the control system in accordance with a preferred 
embodiment of the present invention; 

[0049] FIG. 2 is a perspective view of an example of an actuated prosthesis with a front 
actuator configuration; 

[0050] FIG. 3 is a perspective view of an example of an actuated prosthesis with a rear 
actuator configuration; 

[0051] FIG. 4 is an upper schematic view of an insole provided with plantar pressure sensors; 
[0052] FIG. 5 is a cross sectional view of a sensor shown in FIG. 4; 
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[0053] FIG. 6 is an example of a state machine diagram for the selection of the portion of 
locomotion; 

[0054] FIG. 7 is an example of the phases of locomotion portion within one portion of 
locomotion (BTW) in the state machine diagram shown in FIG. 6; 

[0055] FIGS. 8a to 8d are examples of four data signals using plantar pressure sensors during 
typical walking on flat ground; 

[0056] FIGS. 9a to 9d give an example of a data signal obtained from a plantar pressure sensor 
at the calcaneus region and its first three differentials; 

[0057] FIGS. 10a to lOd give an example of a data signal obtained from a plantar pressure 
sensor at the metatarsophalangeal (MP) region and its first three differentials; 

[0058] FIGS. 11a to lid give an example of the states of a plantar pressure sensor with 
reference to the data signal and its three first differentiations for a plantar pressure sensor at 
the calcaneous region; 

[0059] FIGS. 12a to 12c give an example of the states of a plantar pressure sensor with 
reference to the data signal and its three first differentiation for a plantar pressure sensor at the 
metatarsophalangeal (MP)region; 

[0060] FIG. 13 is an example of a state machine diagram for the selection of the state of the 
plantar pressure sensors for the calcaneous region; 

[0061] FIG. 14 is an example of a state machine diagram for the selection of the state of the 
plantar pressure sensors at the metatarsophalangeal (MP) region; 

[0062] FIG. 15 is an overall block diagram of the Phase Recognition Module (PRM); 

[0063] FIG. 16 is a block diagram showing the zero calibration; 



[0064] FIG. 17 is a block diagram showing the subject's weight calibration; 
[0065] FIG. 18 is a block diagram of the Trajectory Generator (TG); 

[0066] FIG. 19 is a block diagram showing the creation of the Trajectory Generator (TG) 
lookup table; 

[0067] FIG. 20 is a graph showing an example of curve representing a kinematic or kinetic 
variable for a given portion of locomotion, phase of locomotion portion and subject's speed; 
and 

[0068] FIG. 21 is an enlarged representation of FIG. 20. 

ACRONYMS 

[0069] The detailed description and figures refer to the following technical acronyms: 
[0070] A/D Analog/Digital 

[0071] BDW "Downward Inclined Walking - Beginning path" portion of locomotion 

[0072] BGD "Going Down Stairs - Beginning path" portion of locomotion 

[0073] BGU "Going Up Stairs - Beginning path portion of locomotion 

[0074] BTW "Linear Walking - Beginning path" portion of locomotion 

[0075] BTW_SWING Detection of typical walking g r _| e g during leg swing 

[0076] BUW "Upward Inclined Walking - Beginning path" portion of locomotion 

[0077] CDW "Downward Inclined Walking - Cyclical path" portion of locomotion 

[0078] CGD "Going Down Stairs - Cyclical path" portion of locomotion 

[0079] CGU "Going Up Stairs - Cyclical path" portion of locomotion 

[0080] CTW "Linear Walking - Cyclical path" portion of locomotion 
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[0081] CUW "Upward Inclined Walking - Cyclical path" portion of locomotion 

[0082] EC W "Curve Walking Path" portion of locomotion 

[0083] EDW "Downward Inclined Walking - Ending path" portion of locomotion 

[0084] EGD "Going Down Stairs - Ending path" portion of locomotion 

[0085] EGU "Going Up Stairs - Ending path" portion of locomotion 

[0086] ETW "Linear Walking - Ending path" portion of locomotion 

[0087] EUW "Upward Inclined Walking - Ending path" portion of locomotion 

[0088] FRBIN X Detection of a positive f„ 

[0089] FRfst_BIN x Detection of positive first differentiation of f™ 

[0090] FRsec_BIN x Detection of positive second differentiation of f™ 

[009i| FRtrd_BIN x Detection of positive third differentiation of frx 

[0092] FR_HIGH X Detection of f„ level above the STA envelope 

[0093] FR_LOW x Detection of f™ level between the zero envelope and the STA 
envelope 

[0094] FSR Force Sensing Resistor 

[00951 GR_POS y Detection of a positive gry 

[0096] MINJSIT Detection of a minimum time in portion SIT 

[0097] MP Metatarsophalangeal 

[0098] PID Proportional-Integral-Differential 

[0099] PKA_SDWSit down knee angle 

[00100] PKAJETWEnd walking knee angle 

[00101] PKA STA Stance knee angle 
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[00102] PKA SIT Sit down knee angle 

[00103] PKA_SUP_RAMPStanding up knee angle 

[00104] PPMV Plantar Pressure Maximal Variation 

[00105] PPS Plantar Pressure Sensor 

[00106] PRM Phase Recognition Module 

[00107] REG Regulator 

[00108] RF Radio Frequency 

[00109] SDW "Sitting down" portion of locomotion 

[00110] SIT "Sitting" portion of locomotion 

[001 1 1] STA "Stance of feet" portion of locomotion 

[00112] STA BIN Detection of a static evolution of all f n 

[001 13] STATIC GRy Detection of gry level below the zero angular speed 

envelope and the zero acceleration envelope 

[00114] sum a Localized plantar pressure signal of left foot 

[001 15] sumb Localized plantar pressure signal of right foot 

[001 16] sum c Localized plantar pressure signal of both calcaneus 

[00117] sum d Localized plantar pressure signal of both MP 

[00118] sum e Localized plantar pressure signal of both feet 

[00119] SUM_BIN y Non-Zero of sum y 
[00120] SUP "Standing Up" portion of locomotion 

[00121] SVD Singular Values Decomposition 

[00122] SWINGy Detection of a swing prior to a foot strike 
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[00123] TG Trajectory Generator 

[00124] XHLSB Heel Loading State Bottom (X = Left (L) or Right (R)) 

[00125] XHLSM Heel Loading State Middle (X = Left (L) or Right (R)) 

[00126] XHLST Heel Loading State Top (X = Left (L) or Right (R)) 

[00127] XHSTA Heel STAtic state (X = Left (L) or Right (R)) 

[00128] XHUSB Heel Unloading State Bottom (X = Left (L) or Right (R)) 

[00129] XHUST Heel Unloading State Top (X = Left (L) or Right (R)) 

[00130] XHZVS Heel Zero Value State (X = Left (L) or Right (R)) 

[00131] XMLSM MP Loading State Middle (X = Left (L) or Right (R)) 

[00132] XMLST MP Loading State Top (X = Left (L) or Right (R)) 

[00133] XMSTA MP STAtic state (X = Left (L) or Right (R)) 

[00134] XMUSB MP Unloading State Bottom (X = Left (L) or Right (R)) 

[00135] XMUST MP Unloading State Top (X = Left (L) or Right (R)) 

[00136] XMZVS MP Zero Value State (X = Left (L) or Right (R)) 

[00137] ZV_FRfst x Threshold to consider the first differentiation of f re to be 
positive. 

[00138] ZV_FRsec x Threshold to consider the second differentiation of frx to be 
positive. 

[00139] ZV_FRtrd x Threshold to consider the third differentiation of f™ to be 
positive. 

[00140] ZV_FR X Threshold to consider f re to be positive 

[00141] ZV_SUMfst Threshold to consider the absolute value of the 1 st diff. of sum y 
to be positive. 
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[00142] ZV_SUMsec Threshold to consider the absolute value of the 2 nd diff. of sum y 
to be positive 

DETAILED DESCRIPTION OF THE INVENTION 

[00143] The appended figures show a control system (10) in accordance with the 
preferred embodiment of the present invention. It should be understood that the present 
invention is not limited to the illustrated implementation since various changes and 
modifications may be effected herein without departing from the scope of the appended 
claims. 

[00144] FIG. 1 shows the control system (10) being combined with an autonomous 
actuated prosthesis for amputees. It is particularly well adapted for use with an actuated leg 
prosthesis for above-knee amputees, such as the prostheses (12) shown in FIGS. 2 and 3. 
Unlike conventional prostheses, these autonomous actuated prostheses (12) are designed to 
supply the mechanical energy necessary to move them by themselves. The purpose of the 
control system (10) is to provide the required signals allowing to control an actuator (14). To 
do so, the control system (10) is interfaced with the amputee using artificial proprioceptors 
(16) to ensure proper coordination between the amputee and the movements of the actuated 
prosthesis (12). The set of artificial proprioceptors (16) captures information, in real time, 
about the dynamics of the amputee's movement and provides that information to the control 
system (10). The control system (10) is then used to determine the joint trajectories and the 
required force or torque that must be applied by the actuator (14) in order to provide 
coordinated movements. 

[00145] FIG. 2 shows an example of an actuated leg prosthesis (12) for an above-knee 
amputee. This prosthesis (12) is powered by a linear actuator (14). The actuator (14) moves a 
knee member (20) with reference to a trans-tibial member (22), both of which are pivotally 
connected using a first pivot axis. More sophisticated models may be equipped with a more 
complex pivot or more than one pivot at that level. 
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[00146] An artificial foot (24) is provided under a bottom end of the trans-tibial member 
(22). The knee member (20) comprises a connector (25) to which a socket (26) can be 
attached. The socket (26) is used to hold the sump of the amputee. The design of the knee 
member (20) is such that the actuator (14) has an upper end connected to another pivot on the 
knee member (20). The bottom end of the actuator (14) is then connected to a third pivot at 
the bottom end of the trans-tibial member (22). In use, the actuator (14) is operated by 
activating an electrical motor therein. This rotates, in one direction or another, a screw (28). 
The screw (28) is then moved in or out with reference to a follower (30), thereby changing the 
relative angular position between the two movable parts, namely the knee member (20) and 
the trans-tibial member (22). 

[00147] FIG. 3 shows an actuated leg prosthesis (12) in accordance to a rear actuator 
configuration. This embodiment is essentially similar to that of FIG. 2 and is illustrated with a 
different model of actuator (14). 

[00148] It should be noted that the present invention is not limited to the mechanical 
configurations illustrated in FIGS. 2 and 3. The control system (10) may be used with a leg 
prosthesis having more than one joint. For instance, it can be used with a prosthesis having an 
ankle joint, a metatarsophalangeal joint or a hip joint in addition to a knee joint. Moreover, 
instead of a conventional socket a a osseo-integrated devices could also be used, ensuring a 
direct attachment between the mechanical component of the prosthesis and the amputee 
skeleton. Other kinds of prostheses may be used as well. 

[00149] Referring back to FIG. 1, the information provided by the artificial 
proprioceptors (16) are used by the control system (10) to generate an output signal. These 
output signals are preferably sent to the actuator (14) via a power drive (32) which is itself 
connected to a power supply (34), for instance a battery, in order to create the movement. The 
power drive (32) is used to control the amount of power being provided to the actuator (14). 
Since the actuator (14) usually includes an electrical motor, the power drive (32) generally 
supplies electrical power to the actuator (14) to create the movement. 
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[00150] Preferably, feedback signals are received from sensors (36) provided on the 
prosthesis (12). In the case of an actuated leg prosthesis (12) such as the one illustrated in 
FIGS. 2 and 3, these feedback signals may indicate the relative position measured between 
two movable parts and the torque between them. This option allows the control system (10) to 
adequately adjust the output signal. Other types of physical parameters may be monitored as 
well. 

[00151] The control system (10) shown in FIG. 1 comprises an interface (40) through 
which data signals coming from the artificial proprioceptors (16) are received. They may be 
received either from an appropriate wiring or from a wireless transmission. In the case of 
actuated leg prostheses for above-knee amputees, data signals from the artificial 
proprioceptors (16) provided on a healthy leg are advantageously sent through the wireless 
transmission using an appropriate RF module. For example, a simple off-the-shelf RF module 
with a dedicated specific frequency, such as 916 MHz, may be used. For a more robust 
implementation though, the use of a RF module with a spread spectrum or frequency hopper is 
preferable. Of course, other configurations may be used as well, such as a separate A/D 
converter, different resolution or sampling values and various combinations of communication 
link technologies such as wired, wireless, optical, etc. 

[00152] The control system (10) further comprises a part called "Phase Recognition 
Module" or PRM (42). The PRM (42) is a very important part of the control system (10) since 
it is used to determine two important parameters, namely the portion of locomotion and the 
phase of locomotion portion. These parameters are explained later in the text. The PRM (42) 
is connected to a Trajectory Generator, or TG (44), from which dynamic parameters required 
to control the actuated prosthesis (12) are calculated to create the output signal. A lookup 
table (6) is stored in a memory connected to the TG (44). Moreover, the control system (10) 
comprises a regulator (48) at which the feedback signals are received and the output signal can 
be adjusted. 
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[00153] Software residing on an electronic circuit board contains all the above 
mentioned algorithms enabling the control system (10) to provide the required signals 
allowing to control the actuator (14). More specifically, the software contains the following 
three modules: the Phase Recognition Module (PRM), the Trajectories Generator (TG) and the 
Regulator (REG). Of course, any number of auxiliary modules may be added. 

[00154] The artificial proprioceptors (16) preferably comprise main artificial 
proprioceptors and auxiliary artificial proprioceptors. The main artificial proprioceptors are 
preferably localized plantar pressure sensors which measure the vertical plantar pressure of a 
specific underfoot area, while the auxiliary artificial proprioceptors are preferably a pair of 
gyroscopes which measure the angular speed of body segments of the lower extremities and a 
kinematic sensor which measures the angle of the prosthesis knee joint. The plantar pressure 
sensors are used under both feet, including the artificial foot. It could also be used under two 
artificial feet if required. One of the gyroscopes is located at the shank of the normal leg while 
the other is located on the upper portion of the prosthesis above the knee joint. As for the 
kinematic sensor, it is located at the prosthesis knee joint. Other examples of artificial 
proprioceptors (16) are neuro-sensors which measure the action potential of motor nerves, 
myoelectrical electrodes which measure the internal or the external myoelectrical activity of 
muscles, needle matrix implants which measure the cerebral activity of specific region of the 
cerebrum cortex such as motor cortex or any other region indirectly related to the somatic 
mobility of limbs or any internal or external kinematic and/or kinetic sensors which measure 
the position and the torque at any joints of the actuated prosthesis. Of course, depending on 
the application, additional types of sensors which provide information about various dynamics 
of human movement may be used. 

[00155] FIG. 4 shows a right insole (10) provided with two plantar pressure sensors 
(16) positioned at strategic locations. Their size and position were defined in accordance with 
the stability and the richness (intensity) of the localized plantar pressure signals provided by 
certain underfoot areas during locomotion. Experimentation provided numerous data 
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concerning the spatial distribution of foot pressures and more specifically on the Plantar 

Pressure Maximal Variation (PPMV) during locomotion. The PPMV, denoted A max / r; y 9 

was defined as the maximum variation of the plantar pressure at a particular point (underfoot 
area of coordinate i j) during locomotion. The X-Y axis (52) in FIG. 4 was used to determine 
the i j coordinates of each underfoot area. 

[00156] A PPMV of a given underfoot area of coordinates i,j during a given step 
denoted event x, is defined as stable, through a set of N walking steps, if the ratio of the 
absolute difference between this PPMV and the average PPMV over the set is inferior to a 
certain value representing the criteria of stability, thus: 



2> 



A f .| 



f ■ 
max r,y | 



N 



IN 

S ^maxf r ,ij| n 



n=0 



N 



Equation 1 



>100%<(S%) 
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• K is the number of samples (frames), 

• N is the number of steps in the set, 
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S is the chosen criteria to define if a given PPMV is 
stable. 



[00157] A PPMV of a given underfoot area of coordinates i,j during a given step 
denoted event x, is defined as rich in information, through a set of N walking steps, if the ratio 
between the PPMV and the average PPMV of the set is superior to certain value representing 
the criteria of richness, thus: 
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K is the number of samples (frames), 



N is the number of steps in the set, 



R is the chosen criteria to define if a given PPMV 
is rich in information. 



[00158] It was found by experimentation that the size and the position of plantar 
pressure sensor are well defined when the criteria are set at 5 % and 10 % for the stability and 
the richness PPMV respectively. As a result, it was found that the calcaneus and the 
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Metatarsophalangeal (MP) regions are two regions of the foot sole where the PPMV may be 
considered as providing a signal that is both stable and rich in information. 

[00159] In FIG. 4, the plantar pressure sensors (16) are provided in a custom-made 
insole (10), preferably in the form of a standard orthopedic insole, that is modified to embed 
the two sensors (16) for the measurement of two localized plantar pressures. Each sensor (16), 
as shown in FIG. 5, is preferably composed of a thin Force-Sensing Resistor (FSR) polymer 
cell (54) directly connected to the interface (40) or indirectly using an intermediary system 
(not shown), for instance a wireless emitter. Mechanical adapters may be used if FSR cells of 
appropriate size are not available. The FSR cell (54) has a decreasing electrical resistance in 
response to an increasing force applied perpendicularly to the surface thereof. Each cell (54) 
outputs a time variable electrical signal for which the intensity is proportional to the total 
vertical plantar pressure over its surface area. 

[00160] The normalized position of the pressure sensors and their size are shown in 
Table 1, where the length L and the width W are respectively the length and the width of the 
subject's foot. The coefficients in Table 1 have been obtained by experimentation. A typical 
diameter for the plantar pressure sensors (16) is between 20 and 30 mm. 
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Table 1 - Normalized position and size of pressure sensors 



Area 


Position (X, Y) Size (diameter) 


Calcaneus 


(0.51-W.-0.14-L) 0.29 -VL-W 


MP 


(0.7-W,0.76-L) 0.24 -VL-W 



[00161] In use, the PRM (42) ensures, in real-time, the recognition of the phase of 
locomotion portion and the portion of locomotion of an individual based on the information 
provided by the artificial proprioceptors (16). The PRM (42) is said to operate in real time, 
which means that the computations and other steps are performed continuously and with 
almost no delay. 

[00162] In accordance with the present invention, it was found that data signals received 
from individual artificial proprioceptors (16) can provide enough information in order to 
control the actuator (14) of an actuated prosthesis (12). For instance, in the case of plantar 
pressure sensors, it has been noticed experimentally that the slope (first derivative), the sign of 
the concavity (second derivative) and the slope of concavity (third derivative) of the data 
signals received from plantar pressure sensors, and of combinations of those signals, give 
highly accurate and stable information on the human locomotion. The PRM (42) is then used 
to decompose of the human locomotion into three levels, namely the states of each artificial 
proprioceptor (16), the phase of locomotion portion and the portion of locomotion. This 
breakdown ensures the proper identification of the complete mobility dynamics of the lower 
extremities in order to model the human locomotion. 

[00163] The actual states of each main artificial proprioceptor depict the first level of 
the locomotion breakdown. This level is defined as the evolution of the main artificial 
proprioceptors' sensors during the mobility of the lower extremities. Each sensor has its 
respective state identified from the combination of its data signal and its first three differential 
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signals. For the main artificial proprioceptors of the preferred embodiment, which provide 
information about localized plantar pressures, it has been discovered experimentally that the 
localized plantar pressures signals located at the calcaneous and at the metatarsophalangeal 
(MP) regions may be grouped into seven and six states respectively. 

[00164] For the sensors at the calcaneous regions, the states are preferably as follows: 

[00165] XHLSB Heel Loading State Bottom (X = Left (L) or Right (R)) 

[00166] XHLSM Heel Loading State Middle (X = Left (L) or Right (R)) 

[00167] XHLST Heel Loading State Top (X = Left (L) or Right (R)) 

[00168] XHSTA Heel STAtic State (X = Left (L) or Right (R)) 

[00169] XHUSB Heel Unloading State Bottom (X = Left (L) or Right (R)) 

[00170] XHUST Heel Unloading State Top (X = Left (L) or Right (R)) 

[00171] XHZVS Heel Zero Value State (X = Left (L) or Right (R)) 

[00172] For the sensors at the MP regions, the states are preferably as follows: 

[00173] XMLSB MP Loading State Bottom (X = Left (L) or Right (R)) 

[00174] XMLST MP Loading State Top (X = Left (L) or Right (R)) 

[00175] XMSTA MP STAtic State (X = Left (L) or Right (R)) 

[00176] XMUSB MP Unloading State Bottom (X = Left (L) or Right (R)) 

[00177] XMUST MP Unloading State Top (X = Left (L) or Right (R)) 

[00178] XMZVS MP Zero Value State (X = Left (L) or Right (R)) 

[00179] Identifying the states at each sensor allows to obtain the second level of the 
locomotion breakdown, referred to as the phase of locomotion portion. The phase of 
locomotion portion is defined as the progression of the subject's mobility within the third level 
of locomotion breakdown, namely the portion of locomotion. This third level of the 
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locomotion breakdown defines the type of mobility the subject is currently in, such as, for 
example, standing, sitting or climbing up stairs. Each locomotion portion contains a set of 
sequential phases illustrating the progression of the subject's mobility within that locomotion 
portion. The phase sequence mapping for each locomotion portion has been identified by 
experimentation according to the evolution of the state of the localized plantar pressures 
throughout the portion. 



[00180] 


The portions of locomotion are preferably as follows: 


[00181] 


BDW 


"Downward Inclined Walking - Beginning path' 


[00182] 


BGD 


"Going Down Stairs - Beginning path" 


[00183] 


BGU 


"Going Up Stairs - Beginning path 


[00184] 


BTW 


"Linear Walking - Beginning path" 


[00185] 


BUW 


"Upward Inclined Walking - Beginning path" 


[00186] 

L J 


CDW 


"Downward Inclined Walking - Cyclical path" 


fAAl ATI 

[00187] 


CGD 


"Going Down Stairs - Cyclical path" 


[00188] 


CGU 


"Going Up Stairs - Cyclical path" 


[00189] 


CTW 


"Linear Walking - Cyclical path" 


[00190] 


CUW 


"Upward Inclined Walking - Cyclical path" 


[00191] 


ECW 


"Curve Walking Path" 


[00192] 


EDW 


"Downward Inclined Walking - Ending path" 


[00193] 


EGD 


"Going Down Stairs - Ending path" 


[00194] 


EGU 


"Going Up Stairs - Ending path" 


[00195] 


ETW 


"Linear Walking - Ending path" 


[00196] 


EUW 


"Upward Inclined Walking - Ending path" 
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[00197] SDW "Sitting down" 

[00198] SIT "Sitting" 
[00199] STA "Stance of feet" 

[00200] SUP "Standing Up" 

[00201] FIG. 6 illustrates an example of the state machine concerning these various 
portions of locomotion. 

[00202] FIG. 7 shows an example of a phase sequence mapping, BTW_1 to BTW25, 
for the Beginning Path of Linear Walking (BTW) portion of locomotion. All locomotion 
portions have similar patterns of phase sequence mapping, though the number of phases may 
vary from one locomotion portion to another. The number of phases depends on the desired 
granularity of the decomposition of the locomotion portion. The phases are determined 
experimentally by observing the states of the four localized plantar pressures at specific time 
intervals, which are determined by the desired granularity. Since a phase is the combination of 
the states of the four localized plantar pressures, the phase boundary conditions are therefore 
defined as the combination of each localized plantar pressure state boundary conditions. 

[00203] For the selection of the portion of locomotion the subject is in, the algorithm 
uses the state machine approach. For this purpose, the algorithm uses a set of events which 
values define the conditions, or portion boundary conditions, to pass from one locomotion 
portion to another. These events are identified by experimentation according to the evolution 
of the localized plantar pressure signals, the complementary signals and their first three 
differentials, as well as the signals from the auxiliary artificial proprioceptors, when the 
subject passes from one locomotion portion to another. 

[00204] Having determined the states of the main artificial proprioceptors' sensors, the 
phase of locomotion portion and portion of locomotion of the subject, the TG (44) can be used 
to calculate one or more dynamic parameter values to be converted to an output signal for the 
control of the actuator. Examples of dynamic parameter values are the angular displacement 
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and the torque (or moment of force) at the knee joint of the actuated leg prosthesis (12). Since 
these values are given in real time, they provide what is commonly referred to as the "system's 
trajectory". At any time k during the subject's locomotion, a mathematical relationship is 
selected according to the state of the whole system, that is the states of the main artificial 
proprioceptors, the phase of locomotion portion, the portion of locomotion and the walking 
speed. Following which, the angular displacement 0^ and the moment of force are then 
computed using simple time dependant equations and static characteristics associated with the 
state of the system, thereby providing the joint's trajectory to the knee joint member. This 
process is repeated throughout the subject's locomotion. 

[00205] FIGS. 8a to 8d show examples of data signals from the four localized plantar 
pressure sensors (16) during a standard walking path at 109,5 steps/minute. The four signals, 
/ri(t),/r2(t),/r3(t) and / r4 (t), correspond to the variation in time of the localized plantar pressure 
at the calcaneus region of the left foot (FIG. 8a), the MP region of the left foot (FIG. 8b), the 
calcaneus region of the right foot (FIG. 8c), and the MP region of the right foot (FIG. 8d). 

[00206] In accordance with the present invention, the PRM (42) uses the first, the 
second and the third differentials of each of those four localized plantar pressure signals in 
order to determine the sensors' state. From there, the PRM (42) will be able to determine the 
phase of locomotion portion and portion of locomotion of the subject. 

[00207] FIGS. 9a to 9d and 10a to lOd show examples of graphs of localized plantar 
pressures, as well as their first, second and third differentials, at the calcaneus and MP regions 
respectively, for a linear walking path of 109,5 steps/minute. 

[00208] FIGS. 11a to lid show graphically the state boundary conditions for a typical 
localized plantar pressure signal, and its first three differentials, at the calcaneous region, while 
FIGS. 12a to 12c do so for the localized plantar pressure signal, and its first two differentials, 
at the MP region. This shows the relationships between the various data and derivative 
signals, and the states. 
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[00209] In use, for the detection of the state of the four localized plantar pressures, 
denoted f^ where x = [1, 4], the PRM (42) uses a set of first state machines to select, at each 
increment in time, the current state of each sensor. For this purpose, the algorithm uses a set 
of events whose values define the conditions to pass from one state to another for each of the 
localized plantar pressures. Table 2 lists the events: 

Table 2 - List of events used to evaluate the state boundary condition of a localized 

plantar pressure 



Event 


Acronym 


Description 


Non-Zero of frx 


FRJBINx 


Detection of a positive f^ 


First Differentiation of f^ 


FRfst_BIN x 


Detection of positive first differentiation 

Of f re 


Second Differentiation of f ra 


FRsec_BIN x 


Detection of positive second 
differentiation of f^ 


Third Differentiation of f^ 


FRtrd__BIN x 


Detection of positive third differentiation 

Of frx 


Static ^ 


STA_BIN X 


Detection of a static evolution of all f^ 



[00210] The conditions placed on the values of each of the depicted events of Table 2 
define when the state machines pass from one state to another for each of the localized plantar 
pressures. Table 3 lists the thresholds used to assess if the aforementioned conditions are met, 
in which sum y depicts the five complementary signals, for y = [a, e] as described in Table 4, 
while Table 5 shows the mathematical form of the events used to evaluate the state boundary 
condition of the localized plantar pressures. 
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Table 3 - List of thresholds used to evaluate the state boundary condition of a localized 

plantar pressure 



1 hreshold 


A 

Acronym 


Description 


Positive value of f re 


ZV_FR X 


Threshold to consider frx to be positive 


Positive value of df n /dt 


ZV_FRfst x 


Threshold to consider the first ! 
differentiation of f™ to be positive. 


Positive value of d 2 f TX /dt 2 


ZV_FRsec x 


Threshold to consider the second 
differentiation of f^ to be positive. 


Positive value of dH^/df 


ZV_FRtrd x 


Threshold to consider the third 
differentiation of f re to be positive. ! 


Position value of 3sum y /5t 


ZV_SUMfst 


Threshold to consider the absolute value 
of the first differentiation of sum y to be 
positive. 


Positive value of d 2 sum y /dt 2 


ZV_SUMsec 


Threshold to consider the absolute value 
of the second differentiation of sum y to 
be positive 
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Table 4 - List of complementary signals built from the four localized plantar pressure f r i, 

fr2> fr3) fr4* 



Signal 


Acronym 


Description 


Mathematical value 


Left foot 


sum a 


Localized nlantar nre^ure sipnal of 

left foot 


(frl+fe)/2 


Right foot 


surrib 


Localized nlantar nressure signal of 

i^UVUll£jvU VJ 1 C4.J. 1 1(4.1 Ul vO^Ul v Olt^llCll \J 1. 

right foot 


(fr3 + fr4)/2 


Both 
calcaneus 


sum c 


Localized plantar pressure signal of 
both calcaneus 


(fn + fr 3 )/2 


Both MP 


sum d 


Localized plantar pressure signal of 
both MP 


(fr2 + fr4)/2 


Both feet 


sum e 


Localized plantar pressure signal of 
both feet 


(f rl +f r2 + f r3 + f r4 )/4 
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Table 5 - Mathematical formulation of events 



Acronym 



Mathematical form 



FR_BIN X 



0 if f„(k)<ZV_FR I 

1 otherwise 



FRfst BIN X 



0 if ^ W <ZV FRfst r 

1 otherwise 



FRsec BINv 



0 // - <ZV FRsec, 



d\K) 



1 



otherwise 



FRtrd_BIN x 



o // d I" P < >.t r/w, 



otherwise 



STA BIN 



1 



dsum (ji) 



d(k) 



^ 



>ZV_SUMfst 



d 2 sum y (k) 



d\k) 
otherwise 



>ZV SUMsec 



JJ 



Vy 



[00211] FIGS. 13 and 14 show, respectively, the diagrams of the state machines used 
for the detection of the state of the localized plantar pressure at the calcaneous and the MP 
regions, while Tables 6 and 7 summarize the state boundary conditions between the states of 
each localized plantar pressure. 
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Table 6 - List of state boundary conditions defining the states of the main artificial 

proprioceptors at the calcaneus region 



Current 
State 


State Boundary Conditions 


Next State 


Any state 


!FR_BIN X 


XHZVS 


Any state 


FR_BIN X && STA_BIN X 


XHSTA 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
FRsec_BIN x && FRtrd_ BIN X 


XHLSB 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
FRsec_BIN x && !FRtrd_ BIN X 


XHLSM 


Any state 


FR_BIN X && !STA_BIN X && FRfst_BIN x && 
!FRsec_ BIN X 


XHLST 


Any state 


FR_BIN X && !STA_BIN X && !FRfst_BIN x && 
!FRsec_BIN x 


XHUST 


Any state 


FR_BIN X && !STA_BIN X && !FRfst_BIN x && 
FRsec_ BIN X 


XHUSB 



29 



Table 7 - List of state boundary conditions defining the states of the main artificial 
proprioceptors at metatarsophalangeal region 



Current 
State 


State Boundary Conditions 


Next State 


Any state 


!FR_BIN X 


XMZVS 


Any state 


FR_BIN X && STA_BIN X 


XMSTA 


Any state 


FR_BIN X && !STA_BIN X && FRfst_ BIN X && 
FRsec_ BIN X 


XMLSB 


Any state 


FR_BIN X && !STA_BIN X && FRfst_ BIN X && 
!FRsec_ BIN X 


XMLST 


Any state 


FR_BIN X && !STA_BIN X && !FRfst_ BIN X && 
!FRsec_ BIN X 


XMUST 


Any state 


FR_BIN X && !STA_BIN X && !FRfst_BIN x && 
FRsec_ BIN X 


XMUSB 



[00212] FIG. 15 shows a flow chart that depicts the PRM algorithm, which comprises 
two main parts, namely the pre-processing of the main artificial proprioceptors signals and the 
locomotion breakdown, illustrated by blocks 100 and 102 respectively. The sequence of steps 
performed the pre-processing of the main artificial proprioceptors signals, represented by 
block 100, is indicated by the sequence of blocks 104 to 118. At block 104, the four localized 
plantar pressures signals are received from the interface and normalized at block 106 using 
subject specific calibration values. The four normalized local plantar pressures then go 
through the pre-processing steps represented by blocks 104 to 118. At block 112, the four 
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normalized local plantar pressures are filtered to reduce their spectral composition. A counter 
is then initialized at block 108, which in turn starts a loop comprising blocks 1 10 to 116. The 
first step of the loop, at block 110, consist in the differentiation of the signals. The signals 
resulting from the differentiation step are filtered at block 112, in order to limit the noise 
induced during the differential computation, and go through binary formatting at block 114. 
At block 116, the algorithm checks if the counter has reached 3 iterations. If so, the algorithm, 
having computed all first three derivatives of the four normalized local plantar pressures 
signals, exits the loop to block 102. If not, the algorithm proceeds to block 110 where the 
counter is increased at block 118 and the loop is repeated, in order to computed the next 
derivative, by proceeding to block 110. When the loop exists to block 102, the algorithm 
enters into the locomotion breakdown part of the algorithm. The sequence of steps performed 
by the locomotion breakdown, represented by block 102, is indicated by the sequence of 
blocks 120 to 124. From the four normalized local plantar pressures and their first three 
derivatives, block 120 determines the states of each sensor while blocks 122 and 124 
determine the phase and the portion of locomotion, respectively. 

[00213] The normalization step, represented by block 106, consists in levelling the 
magnitude of the raw data signals according to the anthropomorphic characteristics of the 
subject such as, in the preferred embodiment, the subject's weight. The raw data signals of the 
four localized plantar pressures are divided by the total magnitude provided by the four 
sensors during calibration and then provided as the normalized local plantar pressures to block 
110. 

[00214] At block 1 12 the normalized raw signals of the four localized plantar pressures 
and their first three differentials are numerically filtered to reduce their spectral composition, 
as well as to limit the noise induced during the derivative computation. The preferred 
embodiment of the PRM (42) uses a 2 nd order numerical filter in which the cut-off frequency, 
the damping factor and the forward shifting have been set, experimentally, to optimize the 
calculation according to the locomotion portion and the type of signal. The PRM (42) may use 
other types of numerical filters as well, for example a "Butterworth" filter, as long as the 
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filter's dynamic is similar to the one provided by the 2 nd order filter shown thereafter for each 
locomotion portion. Equation 4 shows the mathematical relationships of the 2 nd order 
numerical filter which is implemented within the PRM (42). Table 8 provides examples of 
filtering parameters for three different portions of locomotion. 

Laplace form 

^2 Equation 3 



H(s) = 



s 2 +2-^-co n -s + co 2 



where co 

. co n in the nth damping natural frequency, co n = , r , £ < 1 



• co r is called the resonance frequency for £ < 1 

• £ is the damping factor 
Recursive form 

IK,). M-'±M^_ 



a, +a,z 1 +a,z" 2 



a,y(k) = b 2 x(k - 1) + b 3 x(k - 2) - a 2 y(k - 1) - a 3 y(k - 2) Equation 4 
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where 



a,=l 



a 2 =-2-a-(3 



= a 



b, =0 



b 2 = 1 -a 



P + 



b 3 = a 2 +a 



a = e~ w - 



-p 



p = cos(co r T e ) 
5 = sin(co r T e ) 
T = sampling rate 
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Table 8 - Examples of parameters of 2" order filters used by the PRM 



Portion of locomotion 


Type of 
signal 


Filtering Parameters 


Cut-Off 
Frequency (F c ) 


Damping 

It o 

Factor (z) 


Forward 
Shifting 


Linear Walking - 
Beginning path (BTW) 


Raw 


2 


0.680 


7 


Derivative 


3 


0.700 


3 


Linear Walking - 
Cyclical path (CTW) 


Raw 


2 


0.680 


7 




Derivative 


3 


0.700 


3 


Linear Walking - Ending 
path (ETW) 


Raw 


2 


0.680 


7 


Derivative 


3 


0.700 


3 



[00215] At block 1 10, the derivatives are obtained by the standard method consisting of 
numerically differentiating the current and the previous samples of localized plantar pressures. 

[00216] The derivatives obtained at block 110 then go through binary formatting at 
block 114. The result of the binary formatting operation will be a "1" if the sign of the 
derivative is positive, "0" if it is negative. This step facilitates the identification of the sign 
changes of the differentiated signals as binary events. 
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[00217] At block 120, the PRM (42) determines the current state of each sensor using 
state machines such as the ones shown in FIGS. 13 and 14. 

[00218] In the PRM (42), the states of the localized plantar pressures are preferably 
expressed as a 10-bit words in which each bit corresponds to a specific possible state. Tables 
9 to 12 list the binary equivalents of each state of the localized plantar pressures at the 
calcaneous and the MP regions of the left and the right foot. Of course, words of different bit 
length may be used as well to represent the state of each localized plantar pressure. 

Table 9 - Numerical labels of the states for the localized plantar pressure at calcaneous 

area of the left foot 



State 


Binary Label 


Decimal 
Label 


LHSBS 


00000000001 


0 


LHLSB 


000000000 1 0 


1 


LHLSM 


00000000 100 


2 


LHLST 


0000000 1000 


3 


LHUST 


000000 10000 


4 


LHUSM 


00000 100000 


5 


LHUSB 


0000 1000000 


6 


LHZVS 


000 10000000 


7 


LHSTA 


00 100000000 


8 
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Table 10 - Numerical labels of the states for the localized plantar pressure at 
metatarsophalangeal area of the left foot 



State 


Binary Label 


Decimal 
Label 


LMSBS 


0000000000 1 


0 


LMLSB 


000000000 1 0 


1 


LMLSM 


00000000 100 


2 


LMLST 


0000000 1000 


3 


LMUST 


00000010 0 00 


4 


LMUSM 


00000 100000 


5 


LMUSB 


0000 1000000 


6 


LMZVS 


000 10000000 


7 


LHSTA 


00 100000000 


8 
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Table 11 - Numerical labels of the states for the localized plantar pressure at calcaneous 

area of the right foot 



State 


U ¥ XT A n \7 T i DPT 

oINARY L/ABEL 


Decimal 
Label 


RHSBS 


0000000000 1 


0 


RHLSB 


000000000 1 0 


1 


RHLSM 


00000000 100 


2 


RHLST 


0000000 1000 


3 


RHUST 


000000 10000 


4 


RHUSM 


00000 100000 


5 


RHUSB 


0000 1000000 


6 


RHZVS 


000 10000000 


7 


RHSTA 


00 100000000 


8 
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Table 12 - Numerical labels of the states for the localized plantar pressure at 
metatarsophalangeal area of the right foot 



State 


oINARY LABEL 


Decimal 
Label 


RMSBS 


0000000000 1 


0 


RMLSB 


000000000 10 


1 


RMLSM 


00000000100 


2 


RMLST 


00000001000 


3 


RMUST 


000000 10000 


4 


RMUSM 


00000 100000 


5 


RMUSB 


0000 1000000 


6 ! 


RMZVS 


000 10000000 


7 


RHSTA 


00 100000000 


8 



[00219] At block 122, the PRM (42) generates the phase, which is preferably expressed 
as the direct binary combination of the states of the four localized plantar pressures. 
Accordingly, the phase can be represented by a 40-bit word wherein the lower part of the 
lower half word, the higher part of the lower half word, the lower part of the higher half word 
and the higher part of the higher half word correspond, respectively, to the calcaneous area of 
the left foot, the MP area of the left foot, the calcaneous area of the right foot and the MP area 
of the right foot, as represented in Tables 9 to 12. Table 13 presents an example of the 
identification of a phase from the states of the four localized plantar pressures. 
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Table 13 - Identification of a phase from the states of the main artificial proprioceptors 



State of Localized Plantar Pressure 


Corresponding Phase 


Right Foot 


Left Foot 


MP area 


Calcaneous 


MP area 


Calcaneous 


0000000100 


0000010000 


0000000001 


0000010000 


00000001000000010000 
00000000010000010000 



[00220] At block 124, the PRM (42) selects the portion of locomotion the subject is 
currently using the state machine shown in FIG. 6. Each portion of locomotion is composed 
of a sequence of phases. 

[00221] Accordingly, Table 14 presents the phases sequence mapping for the Beginning 
Path of Linear Walking (BTW) locomotion portion corresponding to FIG. 7. This table shows 
the label, the decimal value and as well the phase boundary conditions of each phase. 
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Table 14 - Example of phases sequence mapping for the locomotion portion labeled 
"Beginning Path of Linear Walking" (BTW) 



j Phase 


Phase Boundary Conditions 


Label 


Value 






* rj 


Fr4 


BTW_1 


27516604800 


8 


8 


8 


8 


BTW_2 


3449396416 


5 


7 


3 


7 


BTW_3 


2281717888 


1 


7 


4 


7 


BTW_4 


4429217920 


2 


7 


5 


7 


BTW_5 


17213489280 


4 


5 


6 


7 


BTW_6 


1731119808 


4 


7 


5 


7 


BTW_7 


34493988992 


5 


7 


5 


7 


BTW_8 


34494087296 


5 


7 


7 


7 


BTW_9 


3436186816 


5 


1 


5 


7 


BTW_10 


34361966720 


5 


1 


7 


7 | 


BTW_11 


68723802240 


6 


2 


7 


7 


BTW_12 


68727996544 


6 


3 


7 


7 


BTW_13 


68727867520 


6 


3 


1 


7 


BTW_14 


137455732864 


7 


4 


1 


7 


BTW_15 


137455734912 


7 


4 


2 


7 


BTW_16 


137455739008 


7 


4 


3 


7 


BTW_17 


13772512128 


7 


5 


2 


7 


BTWJ8 


13772516224 


7 


5 


3 


7 


> BTW_19 


1377252416 


7 


5 


4 


7 


BTW_20 


137573187712 


7 


7 


4 


7 


BTW_21 


137573204096 


7 


7 


5 


7 


BTW_22 


137573187586 


7 


7 


4 


1 
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BTW_23 


137573203970 


7 


7 


5 


1 


BTW_24 


137573236740 


7 


7 


6 


2 


BTW_25 


137573236744 


7 


7 


6 


3 | 















[00222] Table 15 enumerates a sample of boundary conditions associated with the 
locomotion portion of the sitting and typical walking on flat ground movements, while Table 3 
lists the thresholds used to assess if the aforementioned conditions are met. 
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Table 15 - Example of a list of portion boundary conditions defining specific locomotion 
portions such as sitting movements (STA-SUP-SIT-SDW-STA locomotion portion) and 
typical walking on flat ground (STA-BTW-CTW-ETW-STA locomotion portion) 



Current 
Portion 


Set of Events 


i>ext 
Portion 


STA 


SWINGieg 

!STATIC_GRie g || !STATIC_GR pr0St 

FR_LOW pros ,_ h eel 
FR_BIN, eg _heel 

BTW_SWING 


BTW 


FR_HIGH leg _heel 
FR_HIGH pf0 st_heel 

PKA_SDW 


SDW 


BTW 


STATIC_GRi eg 
STATIC_GR pr0 st 


ETW 


SUM_BIN pros t 

SWING pr ost 


CTW 


CTW 


STATICGRieg 
STATIC_GR pros t 


STA 
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Current 
Portion 


dci oi jLvenis 


Next 
Portion 




FR_BIN pr0S t_heei 






r iv_r>iiN ieg_heel 






PKA_ETW 


ETW 




STATIC_GR Ieg || STATIC_GR pr0 st 




¥7 Til 7 

ETW 


rKA_a 1 A 


MA 


SDW 


PKA_SIT 


SIT 


PKA _STA 


STA 




GR_POS|eg 






MIN_SIT 




SIT 


FR_HIGH|eg_ mp 
FR_HIGHp r ost_mp 


SUP 




PKA _STA 


STA 


SUP 


!SUM_BIN pros « 
!SUM_BINie g 


SIT | 


PKA _STA 


STA 




!PKA_SUP_RAMP 


SIT 
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Table 16 - Example of a list of events used to evaluate the portion boundary conditions 
defining specific locomotion portions such as sitting movements (STA-SUP-SIT-SDW- 
STA locomotion portion) and typical walking on flat ground (STA-BTW-CTW-ETW- 

STA locomotion portion) 



Event 


Acromyn 1 


Description 


Swing occurence 


SWINGy 


Detection of a swing prior to a foot strike 


Non-Zero of f™ 


FR_BIN X 


Detection of a positive frx 


T ow 


FR LOWv 


Detection of f™ level between the zero 
envelope and the STA envelope 


Highf^ 


FR_HIGH X 


Detection of f^ level above the STA envelope 


Static gry 


STATICGRy 


Detection of gry level below the zero angular 
speed envelope and the zero acceleration 
envelope 


Non-Zero of sum y 


SUM^BINy 


Detection of a positive sum y 


BTW swing 
occurrence 


BTW_SWING 


Detection of typical walking g r _i e g during leg 
swing 


Positive gry 


GR_POSy 


Detection of a positive gry 


Minimum sitting 


MIN_SIT 


Detection of a minimum time in portion SIT 


Sit down knee angle 


PKA_SDW 


Detection of knee angle higher than the STA 
envelope 


End walking knee 
angle 


PKAETW 


Detection of knee angle lower than the STA 
envelope 
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Event 


Acromyn 


Description 


Stance knee angle 


PKA_STA 


Detection of knee angle lower than the STA 
envelope 


Sit down knee angle 


PKA_SIT 


Detection of knee angle higher than the SIT 
envelope 


Standing up knee 
angle 


PKA_SUP_RA 
MP 


Detection of standing up knee angle evolution 



where • X stands for leg Jieel, leg jnp, prosthetic_heel or prosthetic_mp 
• Y stands for leg or prosthesis 

[00223] The normalization step of block 106 uses specific calibration values. These 
values are computed the first time a subject uses the actuated prosthesis (12) or at any other 
time as may be required. Two calibration values are preferably used: the zero calibration 
value and the subject's weight calibration value. The zero calibration value consists in the 
measurement of the four localized plantar pressures when no pressure is applied to the sensors, 
while the subject's weight calibration value is the subject's weight relative to the magnitude of 
the total response of the sensors. 

[00224] The algorithm to obtain the zero calibration value of the sensors is depicted by 
the flow chart shown in FIG. 16. The sequence of steps composing the algorithm is indicated 
by the sequence of blocks 200 to 222. In block 200, the algorithm starts with the four localized 
plantar pressures. At block 202, the subject sits on a surface high enough such that his feet 
hang freely in the air. Then, at block 204, the subject lightly swings his feet back and forth, 
which initialises a timer at block 206, which in turn starts a loop comprising blocks 208, 210 
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and 212. At block 208, the algorithm checks if the timer has reached 10 seconds, if so, then 
the algorithm exits the loop to block 220, if not, the algorithm proceeds to block 210 and 
records the zero value of the four sensors. Then, at block 212, the timer is increased and the 
loop is repeated by proceeding to block 208. At block 220, the average of each localized 
plantar pressures is computed and finally provided as the zero calibration value at block 222. 

[00225] In a similar fashion, the algorithm to obtain the subject's weight calibration 
value is depicted by the flow chart shown in FIG. 17. The sequence of steps composing the 
algorithm is indicated by the sequence of blocks 300 to 322. In block 300, the algorithm starts 
with the four localized plantar pressure. At block 302, the subject stands up in a comfortable 
position, feet at shoulder width distance, while maintaining the body in the stance position. 
Then, at block 304, the subject slowly swings back and forth and then left to right, which 
initialises a timer at block 306, which in turn starts a loop comprising blocks 308, 310 and 
312. At block 308, the algorithm checks if the timer has reached 10 seconds, if so, then the 
algorithm exits the loop to block 320, if not, the algorithm proceeds to block 310 and records 
the subject's weight relative to the magnitude of the total response of the sensors. Then, at 
block 312, the timer is increased and the loop is repeated by proceeding to block 308. At 
block 320, the average of each localized plantar pressure is computed and finally provided as 
the weight calibration value at block 322. 

[00226] FIG. 18 shows a flow chart that depicts the TG algorithm used to establish a 
relationship, in real-time, between the output of the PRM (42) and localized plantar pressures 
and the knee joint trajectory. The sequence of steps composing the algorithm is indicated by 
the sequence of blocks 400 to 408. At block 400, the algorithm receives the normalized 
localized plantar pressures, the phase of locomotion portion and the portion of the locomotion 
from the PRM (42). Then, at block 402, the walking speed of the subject, in steps per minute, 
is obtained from computing the number of frames between two heel strikes, while taking into 
account the sampling frequency, and is binary formatted. More specifically, the subject's 
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speed estimate £ v [k] (steps/minute) is obtained from computing the number of frames 
between two heel strikes s heel [ k] (frames/step): 

where f s is the frame sampling frequency (frames/second). 
A heel strike event occurs when: 

thresholdheelloading < f ri/ [k] - f rif [k - 1] , i f = 1, 3 Equation 6 

[00227] At block 404, the algorithm uses the normalized localized plantar pressures, the 
phase of locomotion portion, the portion of the locomotion and the subject's speed in binary 
format to identify a set of linear normalized static characteristics linking the knee joint 
kinetic/kinematic parameters with the subject's locomotion in a lookup table. At block 406 
the TG (44) comprises two transformation functions which compute the kinetic/kinematic 
parameters at time k, which are the angular displacement G^k) and the moment of force 
(torque) m kn (k), using the localized plantar pressures and their corresponding mathematical 
relationships (time-dependant equations and static characteristics) identified at block 404. The 
values of the kinetic/kinematic variables are then provided to the REG (48) at block 408. 

[00228] The transformation functions used by the TG (44) at block 406 may generally 
be represented by a system of equations such as: 

9 g(h (k) = Q 1 (3, (k), X (k), v(k)) + Q 2 (» 2 (k), X (k), v(k)) + . . . + Equation 7 

£V, ( V, X00. v(k)) + Q q (» q (k), X (k), v(k)) 

m g h (k) = M , (9, (k), X (k), v(k)) + M 2 (3 2 (k), X (k), v(k)) + . . . + Equation 8 

M i (». , (k), X (k), v(k)) + M q (S q (k), x(k), v(k)) 



where • g = [sagittal (sg), frontal (fr), transversal (tr)] is the plane of the motion 

• h = [hip (hp), knee (kn), ankle (an), metatarsophalangeal (mp)] is the joint 

• q is the number of the main artificial proprioceptors' sensors 

• $ q is the phenomenological entity related to the locomotion and provided by the 
main artificial proprioceptors' sensors 

• Q is the transformation function between the phenomenological entity related to 
the locomotion, the kinematic variables of the lower extremities and the time 

• M q is the transformation function between the phenomenological entity related to 
the locomotion, the kinetic variables of the lower extremities and the time 

• S q is the phenomenological entity related to the locomotion and provided by the 
main artificial proprioceptors' sensors 

• x(k) = ^(p h (k),P r (k),v(k)) is the state of the whole system (amputee and the 
AAP) in which k is the current increment 

• p h (k) is the phase of the respective locomotion portion 

• p r (k) is the locomotion portion 

• v(k) is the walking speed 

• k is the current increment 

[00229] In the case where the TG (44) uses polynomial relationships of order n, 
Equation 7 and Equation 8 become: 
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e g , (k) = a u ( X (k), v(k)) • S, (k) + ... + a 1>n ( X (k), v(k)) • 9, (k) n + Equation 9 

a 2 ,(x(k),v(k))d 2 (k) + ...-i-a 2 , n (x(k) ) v(k))-3 2 (k) n +...+ 
a q . u (x(k),v(k)).9 q . 1 (k) + ... + a q . 1 , n (x(k),v(k)).» q . I (k) n +...+ 
a q , 1 (x(k),v(k)).d q (k) + ... + a qn (x(k) 1 v(k)).d q (k) n 

m g , h (k) = b u (x(k) ) v(k)).» 1 (k) + ... + b 1 , n (x(k),v(k)).d 1 (k) n + Equation 10 

b 2il (x(k),v(k)).9 2 (k) + ... + b 2>n (x(k),v(k))» 2 (k) n + ... + 
b q . u (x(k),v(k)).S q .,(k) + ... + b q . 1 , n (x(k) ) v(k)).d q . I (k) n +... + 
b p ,(x(k),v(k))d q (k) + ... + b q , n (x(k),v(k)).d q (k) n 

where a u (x(k)) and bj j(x(k)) i = l->q are the coefficients for the state x(k) of the 
whole system and the walking speed v(k) and n is the order of the polynomial 

The preferred embodiment uses four localized plantar pressures, thus Equation 9 and Equation 
10 become: 

0 g .h(k) = a u (x(k),v(k)).f rl (k) + ... + a lin (x(k),v(k)).f rl (k) n + Equation 11 

a 2 ,(x(k),v(k))-f r2 (k) + ... + a 2in (x(k),v(k)).f r2 (k) n + 
a 3 , (x(k), v(k)) • f r , (k) + ... + a 3n (x(k), v(k)) • f r3 (k) n + 
a 4 , 1 (x(k),v(k)).f r 3(k) + ... + a 4 , n (x(k),v(k))-f r3 (k) n 

m gh (k) = b u (x(k) 1 v(k)).f rl (k) + ... + b 1 , n (x(k) I v(k))-f rl (k) n + Equation 12 

b 2 , 1 (x(k),v(k))-f r2 (k) + ... + b 2in (x(k),v(k))f r2 (k) n + 
b, 1 (x(k),v(k))-f r3 (k) + ... + b 3in (x(k) ) v(k))-f r3 (k) n + 
b 4 ,(x(k),v(k))f r3 (k) + ... + b 4 , n (x(k),v(k))f r3 (k) n 



where a u (x(k)) and b u (x(k)) i = 1 — > q are the coefficients for the state x(k) of the 
whole system and the walking speed v(k) and n is the order of the polynomial 
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[00230] Since all the kinetic/kinematic parameters O^k) and m kn (k) are computed 
from non complex mathematical relationships, the computation of the trajectory is simple and 
fast and can be calculated by a non-sophisticated electronic circuit board. 

[00231] The mathematical relationships (time-dependant equations and static 
characteristics) used in these non complex mathematical relationships are contained in a 
lookup table referenced at block 404. FIG. 19 shows a flow chart that depicts the algorithm 
used to create the TG lookup table. The sequence of steps composing the algorithm is 
indicated by the sequence of blocks 100 to 512. At block 100, the algorithm measures the 
selected phenomelogical parameters, which in the preferred embodiment are the localized 
plantar pressures, and the kinetc/kinematic parameters 6^00 and m^k) of a subject. The 
measured phenomelogical parameters are then normalized in function of the subject's weight. 
At block 104, the static characteristics linking the phenomelogical parameters to the 
kinetc/kinematic parameters and the time-dependant equations linking to the time are 
identified and are then normalized at block 106. Then at block 108, the mathematical 
relationships (time-dependant equations and static characteristics) are broken down according 
to the phenomelogical parameters, the phases of locomotion portion, portions of locomotion, 
the speed of the subject and in the case were Equation 1 1 and Equation 12 are linear functions, 
the binary formatted data signals. For each set of mathematical relationships (time-dependant 
equations and static characteristics) created by the breakdown, a polynomial regression is 
applied, at block 510, to the mathematical relationships (time-dependant equations and static 
characteristics) contained in the set. Finally, at block 512, the results of the polynomial 
regressions are stored in the lookup table and are indexed according to the breakdown of block 
108. 

[00232] The method for building this TG lookup table depicted by the flow chart of 
FIG. 19 may be applied to any equations belonging to the following analytical/logical family 
of functions: 
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y g ,h = a„ + a,x, + a 2 xf + • • • + a„x? + 
b 0 + b,x 2 +b 2 X2+--- + b m x" + 



P 0 + P,x x + p 2 xJ+- + P n xJ 



II 111 ■ I 

yg,h = Z a i x i + Z b i x 2 + -"ZPi x x 

i=0 i=0 i=0 



"I "2 _ X 

y g .h = E a u x i + Z a 2,i x 2 +-"E a x,i x x 

i=0 i=0 i=0 



X "i 

j=i i=o Equation 13 

where • y g h [ s fa estimated kinematic ( 9 g h ) or kinetic ( m g h ) variables for the g lower 
extremities joint through the h plane of motion 

• g is the lower extremities joint among the following set: hip, knee, ankle and 
metatarsophalangeal 

• h is the plane of motion among the following set: sagittal, frontal and 
transversal 

• xj is the j 01 locomotion related phenomenon, for example the j th localized 
plantar pressure 

• aj,i is the i th coefficient associated the j th locomotion related phenomenon 
denoted Xj 
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• rij is the order of the polynomial depicting the j th locomotion related 
phenomenon denoted Xj 

• % is the number of locomotion related phenomena 

[00233] If it is considered that the family of functions in Equation 13 are dependant on 
the state of the system they depict, thus following system of equations is obtained: 

X n i 

y g ,h =ZZM x )- x j 

j=i i=o Equation 14 

where x is the time dependant state vector of the system 

[00234] In the preferred embodiment, Xj may be substituted by the localized plantar 
pressures denoted f rif , where if = [1, %]. In the case of time-dependant equations, Xj may be 

substituted by the time. Thus, in the case of plantar pressures, Equation 14 becomes: 



X "if 



y g ,h =ZX a i f ,i( x )- f rl 

if =i i=o Equation 15 

where x is the time dependant state vector of the system 

A 

[00235] Previously, y gj h has been defined as the estimated kinematic (0 g>h ) or kinetic 
(m gh ) variable for the g lower extremities joints through the h plan of motion. Thus, 
Equation 15 may be written as: 
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9 g ,h=ZZa if)i (x).f r : 

i f =1 i=0 



or 



"Vh =ZZ a if,i( x )- f r! f 

i f =l i=0 



Equation 16 



Equation 17 



[00236] The goal is the identification of the Equation 16 and Equation 17 functions 
from a set of n s samples, obtained from experimentation. A sample contains data related to 

the locomotion related phenomenon along with the corresponding kinematic (0 g h ) or kinetic 

(m gj h) variables. 

[00237] The following array of data is obtained from experimentation: 
Table 16 - Data obtained from experimentation 





t 


X 




*2 




x j 




x x 




m g,h 


1 






















2 












































h 












Hi, 























































where • j , % is the index and the number of locomotion related phenomena 
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• i s , n s is the index and the number of frames 

• t is the time [s] 

• x is the time dependant state vector of the system 

• x j is the selected locomotion related phenomenon 

• 9 g h is the kinematic variables for the g lower extremities joint through the h 
plan of motion 

• m g h is the kinetic variable for the g lower extremities joint through the h plan 
of motion 

[00238] The logical functions a jfi (x) are then presented in the form of a look-up table, 
as shown in the following example: 
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Table 17 - Look-up table example 



a j.i( x ) 


t 


X 


a i,o 




... 


a 2,0 


a 2.i 


... 


a x.o 


a x.i 


... 


a x,n x 


1 




34. 
5 


23,1 


... 


12,3 


92,5 


... 


83,6 


52,4 


... 


72, 
5 


2 


x 2 


23, 
6 


87,5 


... 


64,4 


84,9 


... 


93,4 


38,6 


... 


28, 
5 


























h 


Xj c 


76, 
9 


82,5 




93,3 


a j.'.'c 




37,5 


82,3 




84, 
4 






























61, 
4 


90,6 




72,3 


26,4 




83,5 


26,4 




28, 
6 



/ CJ n c index and dimension of the look-up table (n c is the number of considered 

where • 

quantized states) 

• x is the time dependant state vector of the system 

[00239] Table 17 establishes the relationship between the time dependent state vector of 
the system, the locomotion related phenomenon and the kinematic and the kinetic variables of 
the lower extremities joints, which are the following static characteristics: 
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9 g h -f (x,x) Equation 18 

m gh = f m (x,x) Equations 

[00240] The methodology used to identify the parameters a^x) is based on the 

application of a curve-fitting algorithm to a set of data provided from experimentation on 
human subjects. This experimentation is performed in a laboratory environment under 
controlled conditions, yielding a set of data in the form of an array, as shown in Table 16. 

[00241] The curve-fitting algorithm is used to obtain the parameters a jfi (x) for every 

given time dependant state vector x . This data is used to construct the look-up table, as 
shown in Table 17. 

[00242] An example of configuration for the method previously described is presented 
below: 

[00243] the particularities of this configuration are: 

a. the locomotion related phenomenon is composed of a set of four localized 
plantar pressures supplied by the main artificial proprioceptors; 

b. the time dependant state vector is composed of: 

i. the walking speed of the subject; 

ii. the phase of locomotion portion and the portion of locomotion; 

iii. and if Equation 16 and Equation 17 are linear functions: 

iv. the binary formatted magnitude of the four localized plantar pressures; 

[00244] the family of functions depicting the static characteristics 0 gh =f (x,x) and 
m g h = f m (x,x) , as described in Equation 16 and Equation 17; 

[00245] or 
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a. the family of functions depicting the time-dependant equations 0 g h = f d (xj) 
and m g h = f m (x,t), as described in Equation 16 and Equation 17 when f rif is 
substituted by time t. 

[00246] the selected lower extremities joints is the knee joint, which is the joint between 
the thigh (th) and the shank (sh); 

[00247] the selected plan of motion is the sagittal plan; 

[00248] In the case where Equation 16 and Equation 17 are linear functions, the time 
dependant state vector further comprises the binary formatted magnitude of the four localized 
plantar pressures as added parameters to further segment the curve representing the kinematic 
(0 gh ) or kinetic (m g> h) variables. This is due to the fact that, as shown by FIG. 20, that for a 

given portion of locomotion, phase of locomotion portion and subject's speed, the curve 
representing the kinematic (0 g h ) or kinetic (i%h) variables cannot efficiently be approximated 

by a linear function. To that end, the binary formatted plantar pressures are used to further 
subdivide the phase of locomotion portion in a number of intervals on which the curve 
representing the kinematic (0 g h ) or kinetic (m g>h ) variables may be approximated by linear 

functions. FIG. 21 is a close-up view of FIG. 20 where it is shown that the curve representing 
the kinematic ( 9 g h ) or kinetic (m g> h) variables appear relatively linear on each of the added 

subdivisions. Thus, the use of Equation 16 and Equation 17 which are linear functions entails 
that the time dependant stated vector will further comprise the binary formatted plantar 
pressures. 

[00249] It should be noted that in the preferred embodiment, the lookup table contains 
mathematical relationships that have been normalized in amplitude. The TG (44) uses the 
relative value of the localized plantar pressures instead of the magnitude of the signal. This 
means that the localized plantar pressures are set into a [0, 1] scale for a specific state of the 
whole system x00- This ensures that the mathematical relationships (time-dependant 
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equations and static characteristics) are independent of the weight of the subject. It is worth to 
note that, because the TG's architecture use the walking speed as a component of the state of 
the whole system, the static characteristics lookup table is valid for any walking speed 
comprised within the operational conditions, which are, in the preferred embodiment, between 
84 and 126 steps/min, though the lookup table may be computed for other intervals. 

[00250] The Regulator (48) uses a control law with a similar structure to control 
algorithms currently employed in numerous commercial or experimental applications. 
Various control laws may be implemented in the Regulator (48), examples of which are 
provided below. 

[00251] First, the Regulator (48) may use a simple PID control law, which is written as: 



kpis the gain associated to the proportional component of the regulator 
kj is the gain associated to the integral component of the regulator 
Xi is the requested trajectory 
x 0 is the trajectory performed by the system 

xis the error between the requested (xj) and performed trajectory (x 0 ) 
|i is the set point intended to the system 




Equation 20 



where 



k<j is the gain associated to the differential component of the regulator 



applied to the proposed system, that is x = 0 or x = m , we have: 




Equation 21 
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where • g = [sagittal (sg), frontal (fr), transversal (tr)] is the plan of the motion 

• h = [hip (hp), knee (kn), ankle (an), metatarsophalangeal (mp)] is the joint 

• x = 0 or m 

where the transfer fiinction between the error x and the set-point is expressed as: 

< h (t) = b 2 -2 2 +tvz + b 0 Equation 22 

x gh (t) z(z-l) 

where • b2 = kj + k p + kd 

• b!=-(k p + k d ) 

• bo = kd 

• x = 0 or m 

in which the corresponding recurrent equation is: 

^ (k) = (k - 1) + b 0 ■ x g>h (k - 2) + b, • x g>h (k - 1) + b 2 • x g>h (k) Equation 23 

where • k is the current increment 

• x = 0 or m 

[00252] Secondly, the Regulator (48) may use an adaptive PID control law. The 
transfer function of an adaptive PID is the same as that of a conventional PID but the 
parameters b2, bi and b 0 are function of the state of the whole system %(k) . From Equation 
23, the recurrence equation of the adaptive PID is: 
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GO = H*, h (k - 1) + b 0 (x(k)) • x gjh (k - 2) + 
b,a(k))-5c ilh (k-l) + b 2 (x(k)).x g<h (k) 



Equation 24 



where • k is the current increment 



• x = 0 or m 



[00253] Thirdly, the Regulator (48) may use a conventional PID with measured 
moment, which may be written as: 

f;, h (k) = f g m h (k) + f g , h (k) Equation 25 

where • f g m h (k) is the force measured at the joint 

• f g h (k) is the force generated by the regulator 

' f g M h (k) is the set point of the force intended to the joint 

[00254] Form Equation 22, the transfer function between the position error x g h and the 
force set-point f g h (k) is expressed as: 



* B ,h(t) 



= K 



b 2 z +bj -z + b 0 



z(z-l) 



Equation 26 



where • K is the gain yielded by the device between the position and the force set point 
• x = 0 or m 

[00255] Thus, the recurrent equation of the final force set point f g M h (k) i s given by the 
following relationship: 
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f£ h (k) = f m (k) + f gJl (k - 1) + b„ • x g>h (k - 2) + Equation 
b 1 -x g>h (k-l) + b 2 .x gih (k) 

where • k is the current increment 



• x = 0 or m 



